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PATENT 

Attorney DjUpWo.: 1 85641-0085 lOUS 

MEASURING AND ANALYZING MULTI-DIMENSIONAL SENSORY 
INFORMATION FOR IDENTIFICATION PURPOSES 

CROSS-REFERENCE TO RELATED APPLICATIONS 

The present application claims priority to U.S. Provisional Patent 
Application Nos. 60/188,569, 60/188,588, and 60/188,589, all of which were filed on 
March 10, 2000, the teachings of each application are hereby incorporated by reference 
for all purposes. 

BACKGROUND OF THE INVENTION 

This invention generally relates to techniques for identifying one or more 
substances using multidimensional data. More particularly, the present invention 
provides systems, methods, and computer code for classifying or identifying one or more 
substances using multi-dimensional data. The multidimensional data can include, among 
others, intrinsic information such as temperature, acidity, chemical composition, and 
color, as well as extrinsic information, such as origin, and age. Merely by way of 
example, the present invention is implemented using fluid substances, but it would be 
recognized that the invention has a much broader range of applicability. The invention 
can be applied to other settings such as chemicals, electronics, biological, medical, 
petrochemical, gaming, hotel, commerce, machining, electrical grids, and the like. 

Techniques and devices for detecting a wide variety of analytes in fluids 
such as vapors, gases and liquids are well known. Such devices generally comprise an 
array of sensors that in the presence of an analyte produce a unique output signature. 
Using pattern recognition algorithms, the output signature, such as an electrical response, 
can be correlated and compared to the known output signature of a particular analyte or 
mixture of substances. By comparing the unknown signature with the stored or known 
signatures, the analyte can be detected, identified, and quantified. Examples of such 
detection devices can be found in U.S. Patent Numbers 5,571,401(Lewis et al.); 
5,675,070 (Gelperin); 5,697,326 (Mottram et al.); 5,788,833 (Lewis et al.); 5,807,701 
(Payne et al.); and 5,891,398 (Lewis et al.), the disclosures of which are incorporated 
herein by reference. 

Generally all of these techniques rely upon a predetermined pattern 
recognition algorithm to analyze data to compare a known signature with an unknown 
signature to detect and identify an unknown analyte. These techniques, however, are 




often cumbersome. They also require highly manual data processing techniques. 
Additionally, each algorithm must often require manual input to be used with the known 
signature. Furthermore, there are many different types of algorithms, which must often 
be used. These different algorithms are often incompatible with each other and cannot be 
5 used in a seamless and cost effective manner. These and many other limitations are 
described throughout the present specification and more particularly below. 

From the above, it is seen that an improved way to identify a characteristic 
of a fluid substance is highly desirable. 



1 0 SUMMARY OF THE INVENTION 

According to the present invention, a technique including systems, 
methods, and computer codes for identifying one or more substances using 
multidimensional data is provided. More particularly, the present invention provides 
systems, methods, and computer codes for classifying or identifying one or more 

1 5 substances using multi-dimensional data. The multidimensional data can include, among 
others, intrinsic information such as temperature, acidity, chemical composition, olfactory 
information, color, sugar content, as well as extrinsic information, such as origin, and age. 

In one specific embodiment, the present invention provides a system 
including computer code for training computing devices for classification or identification 

20 purposes for one or more substances capable of producing olfactory information. The 
computer code is embedded in memory, which can be at a single location or multiple 
locations in a distributed manner. The system has a first code directed to acquiring at 
least first data from a first substance and second data from a second substance to a 
computing device. The data are comprised of a plurality of characteristics to identify the 

25 substance. The system also includes a second code directed to normalizing at least one of 
the characteristics for each of the first data and the second data. Next, the system 
includes computer code directed to correcting at least one of the characteristics for each 
of the first data and the second data. A code directed to processing one or more of the 
plurality of characteristics for each of the first data and the second data in the computing 

30 device using pattern recognition to form descriptors to identify the first substance or the 
second substance also is included. For purposes of this application, the term 
"descriptors" includes model coefficients/parameters, loadings, weightings, and labels, in 
addition to other types of information. A code directed to storing the set of descriptors 
into a memory device coupled to the computing device. The set of descriptions is for 

2 




analysis purposes of one or a plurality of substances. This code and others can be used 
with the present invention to perform the functionality described herein as well as others. 

In a further embodiment, the invention provides a computer program 
product or code in memory for preprocessing information for identification or 
classification purposes. Here, the code is stored in memory at a single location or 
distributed. The product includes a code directed to acquiring a voltage reading firom a 
sensor of a sensing device. The sensor is one of a plurality of sensors that are disposed in 
an array. The code is also provided for determining if the voltage is outside a baseline 
voltage of a predetermined range. If the voltage is outside the predetermined range, the 
code is directed to reject the sensor of the sensing device for use in acquiring sensory 
information. In some embodiments, the present invention further comprises a code 
directed to exposing at least one of the sensors to a sample and acquiring a sample voltage 
from the sample, if the sample voltage is outside a predetermined sample voltage range, 
reject the one exposed sensor. This code and others can be used with the present invention 
to perform the functionality described herein as well as others. 

In yet another embodiment, the present invention provides a system for 
classifying or identifying one or more substances capable of producing olfactory 
information. The system includes a process manager and an input module coupled to the 
process manager. The input module provides at least a first data from a first substance 
and second data from a second substance to a computing device. The data are comprised 
of a plurality of characteristics to identify the substance. The system also includes a 
normalizing module coupled to the process manager for normalizing at least one of the 
characteristics for each of the first data and the second data. A pattern recognition 
module is coupled to the process manager for processing one or more of the plurality of 
characteristics for each of the first data and the second data in the computing device using 
pattern recognition to form descriptors to identify the first substance or the second 
substance. An output module is coupled to the main process manager for storing the set 
of descriptors into a memory device coupled to the computing device. The set of 
descriptions is for analysis purposes of one or a plurality of substances. Depending upon 
the embodiment, other modules can also exist. 

In still another specific embodiment, the present invention provides a 
method for training computing devices for classification or identification purposes for one 
or more substances capable of producing olfactory information. The method includes 
providing at least a first data from a first substance and second data from a second 



substance to a computing device. The data are comprised of a plurality of characteristics 
to identify the substance. The method also includes normalizing at least one of the 
characteristics for each of the first data and the second data. Next, the method includes 
correcting at least one of the characteristics for each of the first data and the second data. 
A step of processing one or more of the plurality of characteristics for each of the first 
data and the second data in the computing device using pattern recognition to form 
descriptors to identify the first substance or the second substance also is included. The 
method then stores the set of descriptors into a memory device coupled to the computing 
device. The set of descriptions is for analysis purposes of one or a plurality of substances. 

In another altemative embodiment, the present invention provides a 
method for teaching a system used for analyzing multidimensional information for one or 
more substances, e.g., liquid, vapor, fluid. The method also includes providing a plurality 
of different substances. Each of the different substances is defined by a plurality of 
characteristics to identify any one of the substances from the other substances, the 
plurality of characteristics being provided in electronic form. The method also includes 
providing a plurality of processing methods. Each of the processing methods is capable 
of processing each of the plurality of characteristics to provide an electronic fingerprint 
for each of the substances. A step of processing each of the plurality of characteristics for 
each of the substances through a first processing method from the plurality of processing 
methods to determine relationships between each of the substances through the plurality 
of characteristics of each of the substances from the first processing method is also 
included. The method further includes processing each of the plurality of characteristics 
for each of the substances through a second processing method to determine relationships 
between each of the substances through the plurality of characteristics for each of the 
substances fi*om the second processing method. The method includes processing each of 
the plurality of characteristics for each of the substances through an nth processing 
method to determine relationships between each of the substances through the plurality of 
characteristics from each of the substances from the nth processing method. The method 
compares the relationships from the first processing method to the relationships from the 
second processing method to the relationships from the nth processing method to find the 
processing method that yields the largest signal to noise ratio to identify each of the 
substances; and selects the processing method that yielded the largest signal to noise ratio. 
The relationships from the selected processing method provide an improved ability to 
distinguish between each of the substances using the selected processing method. 



In still a further embodiment, the invention provides a method for 
preprocessing information for identification or classification purposes. The method 
includes acquiring a voltage reading from a sensor of a sensing device. The sensor is one 
of a plurality of sensors that are disposed in an array. The method also includes 
determining if the voltage is outside a baseline voltage of a predetermined range. If the 
voltage is outside of the predetermined range, the method rejects the sensor of the sensing 
device for use in acquiring sensory information. In some embodiments, the present 
invention further comprises exposing at least one of the sensors to a sample and acquiring 
a sample voltage from the sample, if the sample voltage is outside a predetermined 
sample voltage range, the method rejects the one exposed sensor. 

In yet another embodiment, the present invention provides a system for 
identifying a substance capable of producing olfactory information. The system includes 
a user interface apparatus comprising a display, a graphical user interface, and a central 
processor. The system further includes a process manager operably coupled to the 
display through the central processor. The graphical user interface is capable of imputing 
an information object from a client to manipulate olfaction data and displaying the 
identity of a test substance received from a server. 

Numerous benefits are achieved by way of the present invention over 
conventional techniques. For example, the present invention provides an easy to use 
method for training a process using more than one processing technique. Further, the 
invention can be used with a wide variety of substances, e.g., chemicals, fluids, biological 
materials, food products, plastic products, household goods. Additionally, the present 
invention can remove a need for human intervention in deciding which variables that 
describe a system or process are important or not important. Depending upon the 
embodiment, one or more of these benefits may be achieved. These and other benefits 
will be described in more throughout the present specification and more particularly 
below. 

Various additional objects, features and advantages of the present 
invention can be more fully appreciated with reference to the detailed description and 
accompanying drawings that follow. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a simplified diagram of an environmental information analysis 
system according to an embodiment of the present invention; 



Figs. 2 to 2 A are simplified diagrams of computing device for processing 
information according to an embodiment of the present invention; 

Fig. 3 is a simplified diagram of computing modules for processing 
information according to an embodiment of the present invention; 

Fig. 3 A is a simplified diagram of a capturing device for processing 
information according to an embodiment of the present invention; 

Figs. 4A to 4E are simplified diagrams of methods according to 
embodiments of the present invention; and 

Figs. 5 A to 5L are simplified diagrams of an illustration of an example 
according to the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 
AND PREFERRED EMBODIMENTS 

Fig. 1 is a simplified diagram of an environmental information analysis 
system 100 according to an embodiment of the present invention. This diagram is merely 
an example, which should not limit the scope of the claims herein. One of ordinary skill 
in the art would recognize many other variations, modifications, and altematives. As 
shown, the system 100 includes a variety of elements such as a wide area network 109 
such as, for example, the Intemet, an intranet, or other type of network. Connected to the 
wide area network 109 is an information server 113, with terminal 102 and database 106. 
The wide area network allows for communication of other computers such as a client unit 
112. Client can be configured with many different hardware components and can be 
made in many dimensions, styles and locations (e.g., laptop, palmtop, pen, server, 
workstation and mainframe). 

Terminal 102 is connected to server 113. This connection can be by a 
network such as Ethemet, asynchronous transfer mode, IEEE standard 1553 bus, modem 
connection, universal serial bus, etc. The communication link need not be a wire but can 
be infi*ared, radio wave transmission, etc. Server 1 13 is coupled to the Intemet 109. The 
Intemet is shown symbolically as a cloud or a collection of server routers, computers, and 
other devices 109. The connection to server is typically by a relatively high bandwidth 
transmission medium such as a Tl or T3 line, but can also be others. 

In certain embodiments, Intemet server 113 and database 106 store 
information and disseminate it to consumer computers e.g. over wide area network 109. 
The concepts of "client" and "server," as used in this application and the industry, are 



very loosely defined and, in fact, are not fixed with respect to machines or software 
processes executing on the machines. Typically, a server is a machine e.g. or process that 
is providing information to another machine or process, i.e., the "client," e.g., that 
requests the information. In this respect, a computer or process can be acting as a client 
5 at one point in time (because it is requesting information) and can be acting as a server at 
another point in time (because it is providing information). Some computers are 
consistently referred to as "servers" because they usually act as a repository for a large 
amount of information that is often requested. For example, a WEB site is often hosted 
by a server computer with a large storage capacity, high-speed processor and Intemet link 

10 having the ability to handle many high-bandwidth communication lines. 

In a specific embodiment, the network is also coupled to a plurality of 
sensing devices 105. Each of these sensing devices can be coupled directly to the 
network or through a client computer, such as client 1 12. Sensing devices 105 may be 
connected to a device such as a Fieldbus or CAN that is connected to the Intemet. 

15 Alternatively, sensing devices 105 may be in wireless communication with the Intemet. 

Each of the sensing devices can be similar or different, depending upon the 
application. Each of the sensing devices is preferably an array of sensing elements for 
acquiring olfactory information from fluid substances, e.g., liquid, vapor, liquid/vapor. 
Once the information is acquired, each of the sensing devices transfers the information to 

20 server 113 for processing purposes. In the present invention, the process is performed for 
classifying or identifying one or more substances using the information that includes 
multi-dimensional data. Details of the processing hardware are shown below and 
illustrated by the Figs. 

Fig. 2 is a simplified diagram of a computing device for processing 

25 information according to an embodiment of the present invention. This diagram is merely 
an example, which should not limit the scope of the claims herein. One of ordinary skill 
in the art would recognize many other variations, modifications, and alternatives. 
Embodiments according to the present invention can be implemented in a single 
application program such as a browser, or can be implemented as multiple programs in a 

30 distributed computing environment, such as a workstation, personal computer or a remote 
terminal in a client server relationship. Fig. 2 shows computer system 210 including 
display device 220, display screen 230, cabinet 240, keyboard 250, and mouse 270. 
Mouse 270 and keyboard 250 are representative "user input devices." Mouse 270 
includes buttons 280 for selection of buttons on a graphical user interface device. Other 



examples of user input devices are a touch screen, light pen, track ball, data glove, 
microphone, and so forth. Fig. 2 is representative of but one type of system for 
embodying the present invention. It will be readily apparent to one of ordinary skill in 
the art that many system types and configurations are suitable for use in conjunction with 
the present invention. In a preferred embodiment, computer system 210 includes a 
Pentium^'^ class based computer, running Windows^^ NT operating system by Microsoft 
Corporation. However, the apparatus is easily adapted to other operating systems and 
architectures by those of ordinary skill in the art without departing from the scope of the 
present invention. 

As noted, mouse 270 can have one or more buttons such as buttons 280. 
Cabinet 240 houses familiar computer components such as disk drives, a processor, 
storage device, etc. Storage devices include, but are not limited to, disk drives, magnetic 
tape, soUd state memory, bubble memory, etc. Cabinet 240 can include additional 
hardware such as input/output (I/O) interface cards for connecting computer system 210 
to external devices external storage, other computers or additional peripherals, which are 
further described below. 

Fig. 2 A is an illustration of basic subsystems in computer system 210 of 
Fig. 2. This diagram is merely an illustration and should not limit the scope of the claims 
herein. One of ordinary skill in the art will recognize other variations, modifications, and 
alternatives. In certain embodiments, the subsystems are interconnected via a system bus 

275. Additional subsystems such as a printer 274, keyboard 278, fixed disk 279, monitor 

276, which is coupled to display adapter 282, and others are shown. Peripherals and 
input/output (I/O) devices, which couple to I/O controller 271, can be connected to the 
computer system by any number of means known in the art, such as serial port 277. For 
example, serial port 277 can be used to connect the computer system to a modem 281, 
which in tum connects to a wide area network such as the Internet, a mouse input device, 
or a scanner. The interconnection via system bus allows central processor 273 to 
communicate with each subsystem and to control the execution of instructions from 
system memory 272 or the fixed disk 279, as well as the exchange of information 
between subsystems. Other arrangements of subsystems and interconnections are readily 
achievable by those of ordinary skill in the art. System memory, and the fixed disk are 
examples of tangible media for storage of computer programs, other types of tangible 
media include floppy disks, removable hard disks, optical storage media such as CD- 
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ROMS and bar codes, and semiconductor memories such as flash memory, read-only- 
memories (ROM), and battery backed memory. 

Fig. 3 is a simpHfied diagram of computing modules 300 in a system for 
processing information according to an embodiment of the present invention This 
5 diagram is merely an example which should not limit the scope of the claims herein. One 
of ordinary skill in the art would recognize many other variations, modifications, and 
altematives. As shown, the computing modules 300 include a variety of processes, which 
couple to a process manager 314. The processes include an upload process 301, a filter 
process 302, a baseline process 305, a normalization process 307, a pattern process 309, 
10 and an output process 311. Other processes can also be included. Process manager also 
couples to data storage device 333 and oversees the processes. These processes can be 
implemented in software, hardware, firmware, or any combination of these in any one of 
C3 the hardware devices, which were described above, as well as others, 

eg The upload process takes data from the acquisition device and uploads 

If, 15 them into the main process manager 314 for processing. Here, the data are in electronic 
in form. In embodiments where the data has been stored in data storage, they are retrieved 

I — 

i J and then loaded into the process. Preferably, the data can be loaded onto workspace to a 

text file or loaded into a spreadsheet for analysis. Next, the filter process 302 filters the 
data to remove any imperfections. As merely an example, data from the present data 
20 acquisition device are often accompanied with glitches, high frequency noise, and the 
like. Here, the signal to noise ratio is often an important consideration for pattern 
recognition especially when concentrations of analytes are low, exceedingly high, or not 
within a predefined range of windows according to some embodiments. In such cases, it 
is desirable to boost the signal to noise ratio using the present digital filtering technology. 
25 Examples of such filtering technology includes, but is not limited to a Zero Phase Filter, 
an Adaptive Exponential Moving Average Filter, and a Savitzky-Golay Filter, which will 
be described in more detail below. 

The data go through a baseline correction process 305. Depending upon 
the embodiment, there can be many different ways to implement a baseline correction 
30 process. Here, the baseline correction process finds response peaks, calculates AR/R, and 
plots the AR/R verses time stamps, where the data have been captured. It also calculates 
maximum AR/R and maximum slope of AR/R for ftirther processing. Baseline drift is 
often corrected by way of the present process. The main process manager also oversees 



ft ^ 



U 



9 



that data traverse through the normaHzation process 307. In some embodiments, 
normaUzation is a row wise operation. Here, the process uses a so-called area 
normalization. After such normalization method, the sum of data along each row is imity. 
Vector length normalization is also used, where the sum of data squared of each row 
5 equals unity. 

Next, the method performs a main process for classifying each of the 
substances according to each of their characteristics in a pattem recognition process. The 
pattern recognition process uses more than one algorithm, which are known, are presently 
being developed, or will be developed in the fiiture. The process is used to find weighting 
10 factors for each of the characteristics to ultimately determine an identifiable pattem to 

uniquely identify each of the substances. That is, descriptors are provided for each of the 
substances. Examples of some algorithms are described throughout the present 

t ■ * 

S specification. Also shown is the output module 311. The output module is coupled to the 

process manager. The output module provides for the output of data from any one of the 

fU 15 above processes as well as others. The output module can be coupled to one of a plurality 

i =1 

of output devices. These devices include, among others, a printer, a display, and a 
^ network interface card. The present system can also include other modules. Depending 

upon the embodiment, these and other modules can be used to implement the methods 
according to the present invention. 
20 The above processes are merely illustrative. The processes can be 

n 

performed using computer software or hardware or a combination of hardware and 
software. Any of the above processes can also be separated or be combined, depending 
upon the embodiment. In some cases, the processes can also be changed in order without 
limiting the scope of the invention claimed herein. One of ordinary skill in the art would 
25 recognize many other variations, modifications, and altematives. 

Fig. 3 A is a simplified diagram of a top-view 350 of an information- 
capturing device according to an embodiment of the present invention. This diagram is 
merely an example, which should not limit the scope of the claims herein. One of 
ordinary skill in the art would recognize many other variations, modifications, and 
30 altematives. As shown, the top view diagram includes an array of sensors, 351 A, 35 IB, 
351C, 359nth. The array is arranged in rows 351, 352, 355, 357, 359 and columns, which 
are normal to each other. Each of the sensors has an exposed surface for capturing, for 
example, olfactory information from fluids, e.g., liquid and/or vapor. The diagram shown 
is merely an example. Details of such information-capturing device are provided in U.S. 
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Application No. 09/548,948 and U.S. Patent No. 6,085,576, commonly assigned, and 
hereby incorporated by reference for all purposes. Other devices are commercially 
available from Osmetech, Hewlett Packard, Alpha-MOS, or other companies. 

Although the above has been described in terms of a capturing device for 
5 fluids including liquids and/or vapors, there are many other types of capturing devices. 
For example, other types of information capturing devices for converting an intrinsic or 
extrinsic characteristic to a measurable parameter can be used. These information 
capturing devices include, among others, pH monitors, temperature measurement devices, 
humidity devices, pressure sensors, flov^ measurement devices, chemical detectors, 

1 0 velocity measurement devices, weighting scales, length measurement devices, color 
identification, and other devices. These devices can provide an electrical output that 
corresponds to measurable parameters such as pH, temperature, humidity, pressure, flow, 
chemical types, velocity, weight, height, length, and size. 

In some aspects, the present invention can be used with at least two sensor 

15 arrays. The first array of sensors comprises at least two sensors (e.g., three, four, 

hundreds, thousands, millions or even billions) capable of producing a first response in 
the presence of a chemical stimulus. Suitable chemical stimuli capable of detection 
include, but are not limited to, a vapor, a gas, a liquid, a solid, an odor or mixtures 
thereof. This aspect of the device comprises an electronic nose. Suitable sensors 

20 comprising the first array of sensors include, but are not limited to 

conducting/nonconducting regions sensor, a SAW sensor, a quartz microbalance sensor, a 
conductive composite sensor, a chemiresistor, a metal oxide gas sensor, an organic gas 
sensor, a MOSFET, a piezoelectric device, an infi*ared sensor, a sintered metal oxide 
sensor, a Pd-gate MOSFET, a metal FET structure, a electrochemical cell, a conducting 

25 polymer sensor, a catalytic gas sensor, an organic semiconducting gas sensor, a solid 
electrolyte gas sensor, and a piezoelectric quartz crystal sensor. It will be apparent to 
those of skill in the art that the electronic nose array can be comprises of combinations of 
the foregoing sensors. A second sensor can be a single sensor or an array of sensors 
capable of producing a second response in the presence of physical stimuli. The physical 

30 detection sensors detect physical stimuli. Suitable physical stimuli include, but are not 
limited to, thermal stimuli, radiation stimuli, mechanical stimuli, pressure, visual, 
magnetic stimuli, and electrical stimuli. 

Thermal sensors can detect stimuli which include, but are not limited to, 
temperature, heat, heat flow, entropy, heat capacity, etc. Radiation sensors can detect 



stimuli that include, but are not limited to, gamma rays, X-rays, ultra-violet rays, visible, 
infrared, microwaves and radio waves. Mechanical sensors can detect stimuli which 
include, but are not limited to, displacement, velocity, acceleration, force, torque, 
pressure, mass, flow, acoustic wavelength, and amplitude. Magnetic sensors can detect 
5 stimuli that include, but are not limited to, magnetic field, flux, magnetic moment, 

magnetization, and magnetic permeability. Electrical sensors can detect stimuli which 
include, but are not limited to, charge, current, voltage, resistance, conductance, 
capacitance, inductance, dielectric permittivity, polarization and frequency. 

In certain embodiments, thermal sensors are suitable for use in the present 
10 invention that include, but are not limited to, thermocouples, such as a semiconducting 
thermocouples, noise thermometry, thermoswitches, thermistors, metal thermoresistors, 
semiconducting thermoresistors, thermodiodes, thermotransistors, calorimeters, 
^,0 thermometers, indicators, and fiber optics. 

m In other embodiments, various radiation sensors are suitable for use in the 

ry 15 present invention that include, but are not limited to, nuclear radiation microsensors, such 

as scintillation counters and solid state detectors, ultra-violet, visible and near infrared 
radiation microsensors, such as photoconductive cells, photodiodes, phototransistors, 

3 infrared radiation microsensors, such as photoconductive IR sensors and pyroelectric 

n sensors. 

2 20 In certain other embodiments, various mechanical sensors are suitable for 

^ use in the present invention and include, but are not limited to, displacement 

microsensors, capacitive and inductive displacement sensors, optical displacement 
sensors, ultrasonic displacement sensors, pyroelectric, velocity and flow microsensors, 
transistor flow microsensors, acceleration microsensors, piezoresistive 
25 microaccelerometers, force, pressure and strain microsensors, and piezoelectric crystal 
sensors. 

In certain other embodiments, various chemical or biochemical sensors are 
suitable for use in the present invention and include, but are not limited to, metal oxide 
gas sensors, such as tin oxide gas sensors, organic gas sensors, chemocapacitors, 
30 chemodiodes, such as inorganic Schottky device, metal oxide field effect transistor 

(MOSFET), piezoelectric devices, ion selective FET for pH sensors, polymeric humidity 
sensors, electrochemical cell sensors, pellistors gas sensors, piezoelectric or surface 
acoustical wave sensors, infrared sensors, surface plasmon sensors, and fiber optical 
sensors. 

12 



Various other sensors suitable for use in the present invention include, but 
are not limited to, sintered metal oxide sensors, phthalocyanine sensors, membranes, Pd- 
gate MOSFET, electrochemical cells, conducting polymer sensors, lipid coating sensors 
and metal FET structures. In certain preferred embodiments, the sensors include, but are 
5 not limited to, metal oxide sensors such as a Tuguchi gas sensors, catalytic gas sensors, 
organic semiconducting gas sensors, solid electrolyte gas sensors, piezoelectric quartz 
crystal sensors, fiber optic probes, a micro-electro-mechanical system device, a micro- 
opto-electro-mechanical system device and Langmuir-Blodgett films. 

Additionally, the above description in terms of specific hardware is merely 
1 0 for illustration. It would be recognized that the fiinctionality of the hardware be 

combined or even separated with hardware elements and/or software. The functionality 
can also be made in the form of software, which can be predominantly software or a 
^3 combination of hardware and software. One of ordinary skill in the art would recognize 

f3 many variations, alternatives, and modifications. Details of methods according to the 

1 5 present invention are provided below. 

A method using digital olfaction information for populating a database for 
identification or classification purposes according to the present invention may be briefly 
outlined as follows: 

£3 . 1 . Acquire olfactory data, where the data are for one or more 

20 substances, each of the substances having a plurality of distinct characteristics; 

2. Convert olfactory data into electronic form; 

3. Provide olfaction data in electronic form (e.g., text, normalized 
data fi-om an array of sensors) for classification or identification; 

4. Load the data into a first memory by a computing device; 
25 5. Retrieve the data fi*om the first memory; 

6. Remove first noise levels fi-om the data using one or more filters; 

7. Correct data to a baseline for one or more variables such as drift, 
temperature, humidity, etc.; 

8. Normalize data using a baseline; 
30 9. Reject one or more of the plurality of distinct characteristics fi"om 

the data; 

10. Perform one or more pattern recognition methods on the data; 
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1 1 . Classify the one or more substances based upon the pattern 
recognition methods to form multiple classes that each corresponds to a different 
substance; 

12. Determine optimized (or best general fit) pattem recognition 
5 method via cross validation process; 

13. Store the classified substances into a second memory for further 

analysis; and 

14. Perform other steps, as desirable. 

The above sequence of steps is merely an example of a way to teach or 

10 train the present method and system. The present example takes more than one different 
substance, where each substance has a plurality of characteristics, which are capable of 
being detected by sensors. Each of these characteristics are measured, and then fed into 
the present method to create a training set. The method includes a variety of data 
processing techniques to provide the training set. Depending upon the embodiment, some 

15 of the steps may be separated even further or combined. Details of these steps are 
provided below according to Figs. 

Figs 4A to 4B are simplified diagrams of methods according to 
embodiments of the present invention. These diagrams are merely examples, which 
should not limit the scope of the claims herein. One of ordinary skill in the art would 

20 recognize many other variations, modifications, and alternatives. As shown, the present 
method 400 begins at start, step 401. The method then captures data (step 403) from a 
data acquisition device. The data acquisition device can be any suitable device for 
capturing either intrinsic or extrinsic information from a substance. As merely an 
example, the present method uses a data acquisition device for capturing olfactory 

25 information. The device has a plurality of sensors, which convert a scent or olfaction 

print into an artificial or electronic print. In a specific embodiment, such data acquisition 
device is disclosed in WO 99/47905, WO 00/52444 and WO 00/79243 all commonly 
assigned and hereby incorporated by reference for all purposes. Those of skill in the art 
will know of other devices including other electronic noses suitable for use in the present 

30 invention. In a specific embodiment, the present invention captures olfactory information 
from a plurality of different liquids, e.g., isopropyl alcohol, water, toluene. The olfactory 
information from each of the different liquids is characterized by a plurality of 
measurable characteristics, which are acquired by the acquisition device. Each different 
liquid including the plurality of measurable characteristics can be converted into an 
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electronic data form for use according to the present invention. Some of these 
characteristics were previously described, but can also include others. 

Next, the method transfers the electronic data, now in electronic form, to a 
computer-aided process (step 405). The computer-aided process may be automatic and/or 
5 semiautomatic depending upon the application. The computer-aided process can store the 
data into memory, which is coupled to a processor. When the data is ready for use, the 
data is loaded into the process, step 407. In embodiments where the data has been stored, 
they are retrieved and then loaded into the process. Preferably, the data can be loaded 
onto workspace to a text file or loaded into a spreadsheet for analysis. Here, the data can 
10 be loaded continuously and automatically, or be loaded manually, or be loaded and 
monitored continuously to provide real time analysis. 

The method filters the data (step 41 1) to remove any imperfections. As 
merely an example, data from the present data acquisition device are often accompanied 
?^ with glitches, high frequency noise, and the like. Here, the signal to noise ratio is often 

15 an important consideration for pattern recognition especially when concentrations of 
analytes are low, exceedingly high, or not within a predefined range of windows 
according to some embodiments. In such cases, it is desirable to boost the signal to noise 
□ ratio using the present digital filtering technology. Examples of such filtering technology 

includes, but is not limited to, a Zero Phase Filter, an Adaptive Exponential Moving 
S 20 Average Filter, and a Savitzky-Golay Filter, which will be described in more detail 
below. 

Optionally, the filtered responses can be displayed, step 415. Here, the 
present method performs more than one of the filtering techniques to determine which 
one provides better results. By way of the present method, it is possible to view the detail 

25 of data preprocessing. The method displays outputs (step 415) for each of the sensors, 
where signal to noise levels can be visually examined. Alternatively, analytical 
techniques can be used to determine which of the filters worked best. Each of the filters 
are used on the data, step 416 via branch 418. Once the desired filter has been selected, 
the present method goes to the next step. 

30 The method performs a baseline correction step (step 417). Depending 

upon the embodiment, there can be many different ways to implement a baseline 
correction method. Here, the baseline correction method finds response peaks, calculates 
AR/R, and plots the AR/R verses time stamps, where the data have been captured. It also 
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calculates maximum AR/R and maximum slope of AR/R for further processing. Baseline 
drift is often corrected by way of the present step. Once baseline drift has been corrected, 
the present method undergoes a normalization process, although other processes can also 
be used. Here, AR/R can be determined using one of a plurality of methods, which are 
5 known, if any, or developed according to the present invention. As will be apparent to 
those of skill in the art, although in the example resistance is used, the method can use 
impedance, voltage, capacitance and the like as a sensor response. 

As merely an example, Fig. 4C illustrates a simplified plot of a signal and 
various components used in the calculation of AR/R, which can be used depending upon 
10 the embodiment. This diagram is merely an illustration, which should not limit the scope 
of the claims herein. One of ordinary skill in the art would recognize many other 
variations, modifications, and alternatives. As shown, the diagram shows a pulse, which 
is plotted along a time axis, which intersects a voltage, for example. The diagram 
W includes a AR (i.e., delta R), which is defined between R and R(max). As merely an 

fU 15 example, AR/R is defined by the following expression: 
il AR/R = (R(max) - R(0))/R 

wherein: AR is defined by the average difference between a baseline value R(0) 
£3 and R(max); R (max) is defined by a maximum value of R; R (0) is defined by an initial 

value of R: and R is defined as a variable or electrical measurement of resistance fi*om a 

- n 

1^ 20 sensor, for example. 

H This expression is merely an example, the term AR/R could be defined by 

a variety of other relationships. Here, AR/R has been selected in a manner to provide an 
improved signal to noise ratio for the signals from the sensor, for example. There can be 
many other relationships that define AR/R, which may be a relative relation in another 

25 manner. Alternatively, AR/R could be an absolute relationship or a combination of a 

relative relationship and an absolute relationship. Of course, one of ordinary skill in the 
art would provide many other variations, alternatives, and modifications. 

As noted, the method includes a normalization step, step 419. In some 
embodiments, normalization is a row wise operation. Here, the method uses a so-called 

30 area normalization. After such normalization method, the sum of data along each row is 
unity. Vector length normalization is also used, where the sum of data squared of each 
row equals unity. 
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As shown by step 421, the method may next perform certain preprocessing 
techniques. Preprocessing can be employed to ehminate the effect on the data of 
inclusion of the mean value in data analysis, or of the use of particular units of 
measurement, or of large differences in the scale of the different data types received. 
Examples of such preprocessing techniques include mean centering and auto scaling. 
Preprocessing techniques utilized for other purposes include for example, smoothing, 
outUer rejection, drift monitoring, and others. Some of these techniques will be described 
later. Once preprocessing has been completed, the method performs a detailed processing 
technique. 

Next, the method performs a main process for classifying each of the 
substances according to each of their characteristics, step 423. Here, the present method 
performs a pattem recognition process, such as the one illustrated by the simplified 
diagram in Fig. 4B. This diagram is merely an example, which should not limit the scope 
of the claims herein. 

As shown, method 430 begins with start, step 428. The method queries a 
library, including a plurality of pattem recognition algorithms (e.g.. Table I below), and 
loads (step 431) one or more of the algorithms in memory to be used. The method selects 
the one algorithm, step 432, and runs the data through the algorithm, step 433. In a 
specific embodiment, the pattem recognition process uses more than one algorithms, 
which are known, are presently being developed, or will be developed in the future. The 
process is used to find weighting factors based upon descriptors for each of the 
characteristics to ultimately determine an identifiable pattem to uniquely identify each of 
the substances. The present method runs the data, which have been preprocessed, through 
each of the algorithms. Representative algorithms are set forth in Table 1. 



TABLE I 



PCA 


Principal Components Analysis 


HCA 


Hierarchical Cluster Analysis 


KNNCV 


K Nearest Neighbor Cross Validation 


KNNPrd 


K Nearest Neighbor Prediction 


SIMCA CV 


SIMCA Cross Validation 


SIMCA Prd 


SIMCA Prediction 


Canon CV 


Canonical Discriminant Analysis and Cross 
Validation 


Canon Prd 


Canonical Discriminant Prediction 


Fisher CV 


Fisher Linear Discriminant Analysis and 
Cross Validation 


Fisher Prd 


Fisher Linear Discriminant Prediction 
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PCA and HCA, are unsupervised learning methods. They can be used for investigating 
training data and finding the answers of: 



TABLE II 



T 
J. • 


How manv Drincioal comoonents will cover 
the most of variances? 


II. 


How many principal components to 
choose? 


III. 


How do the loading plots look? 


IV. 


How do the score plots look? 


V. 


How are the scores separated among the 
classes? 


VI. 


How are the clusters grouped in their 
classes? 


VII. 


How much are the distances among the 
clusters? 



The other four algorithms, KNN CV, SIMCA CV, Canon CV, and Fisher CV, are 
supervised learning methods used when the goal is to construct models to be used to 
classify future samples. These algorithms will do cross validation, find the optimum 
number of parameters, and build models. 

Once the data has been run through the first algorithm, for example, the 
method repeats through a branch (step 435) to step 432 to another process. This process 
is repeated until one or more of the algorithms have been used to analyze the data. The 
process is repeated to try to find a desirable algorithm that provides good results with a 
specific preprocessing technique used to prepare the data. If all of the desirable 
algorithms have been used, the method stores (or has previously stored) (step 437) each 
of the results of the processes on the data in memory. 

In a specific embodiment, the present invention provides a cross-validation 
technique. Here, an auto (or automatic) cross-validation algorithm has been implemented. 
The present technique uses cross-validation, which is an operation process used to 
validate models built with chemometrics algorithms based on training data set. During 
the process, the training data set is divided into calibration and validation subsets. A 
model is built with the calibration subset and is used to predict the validation subset. The 
training data set can be divided into calibration and validation subsets called 'ieave-one- 
out", i.e., take one sample out fi-om each class to build a validation subset and use the rest 
samples to build a calibration subset. This process can be repeated using different subset 
until every sample in the training set has been included in one validation subset. The 
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predicted results are stored in an array. Then, the correct prediction percentages (CPP) 
are calculated, and are used to validate the performance of the model. One of ordinary 
skill in the art would recognize other techniques for determining calibration and 
validation sets when performing either internal cross-validation or external cross- 
5 validation. 

According to the present method, a cross-validation with one training data 
set can be applied to generally all the models built with different algorithms, such as K- 
Nearest Neighbor (KNN), SIMCA, Canonical Discriminant Analysis, and Fisher Linear 
Discriminant Analysis, respectively. The results of correct prediction percentages (CPP) 
10 show the performance differences with the same training data set but with different 

algorithms. Therefore, one can pick up the best algorithm according to the embodiment. 

During the model building, there are several parameters and options to 
choose. To build the best model with one algorithm, cross-validation is also used to find 
the optimum parameters and options. For example, in the process of building a KNN 
ry 15 model, cross-validation is used to validate the models built with different number of K, 
?V different scaling options, e.g., mean-centering or auto-scaling, and other options, e.g., 

with PC A or without PC A, to find out the optimum combination of K and other options. 
In an alternative embodiment, auto-cross-validation is implemented using a single push- 
button for ease in use. It automatically runs the processes mentioned above over all the 
20 (or any selected) algorithms with the training data set to determine the optimum 
combination of parameters, scaling options and algorithms. 

The method also performs additional steps of retrieving data, step 438, and 
retrieving the process or algorithm, step 439. As noted, each of the processes can form a 
descriptor for each sample in the training set. Each of these descriptors can be stored and 
25 retrieved. Here, the method stores the raw data, the preprocessed data, the descriptors, 
and the algorithm used for the method for each algorithm used according to the present 
invention. The method stops at step 441. 

The above sequence of steps is merely illustrative. The steps can be 
performed using computer software or hardware or a combination of hardware and 
30 software. Any of the above steps can also be separated or be combined, depending upon 
the embodiment. In some cases, the steps can also be changed in order without limiting 
the scope of the invention claimed herein. One of ordinary skill in the art would 
recognize many other variations, modifications, and alternatives. 
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An alternative method according to the present invention is briefly 



10 



15 



20 



25 



30 



outlined as follows: 

1. 
2. 
3. 
4. 
5. 
6. 
7. 
8. 
9. 



Acquire raw data in voltages; 
Check baseline voltages; 
Filter; 

Calculate AR/R 

Determine Training set? 

If yes, find samples (may repeat process); 

Determine outlier?; 

If yes, remove bad data using, for example PCA; 

Find important sensors using importance index (individual filtering 



process); 



10. 



Normalize: 



1 1 . Find appropriate pattering recognition process; 

12. Run each pattern recognition process; 

13. Display (optional); 

14. Find best fit out of each pattern recognition process; 

15. Compare against confidence factor; 

16. Perform other steps, as required. 

The above sequence of steps is merely an example of a way to teach or 
train the present method and system according to an alternative embodiment. The present 
example takes more than one different substance, where each substance has a plurality of 
characteristics, which are capable of being detected by sensors or other sensing devices. 
Each of these characteristics is measured, and then fed into the present method to create a 
training set. The method includes a variety of data processing techniques to provide the 
training set. Depending upon the embodiment, some of the steps may be separated even 
further or combined. Details of these steps are provided below according to Figs. 

Figs. 4D and 4E are simplified diagrams of methods according to 
embodiments of the present invention. These diagrams are merely examples, which 
should not limit the scope of the claims herein. One of ordinary skill in the art would 
recognize many other variations, modifications, and alternatives. As shown, the present 
method 450 begins at step 45 1 . Here, the method begins at a personal computer host 
interface, where the method provides a training set of samples (which are each defined as 
a different class of material) to be analyzed or an unknown sample (once the training set 
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has been processed). The training set can be derived from a plurality of different samples 
of fluids (or other substances or information). The samples can range in number from 
more than one to more than five or more than ten or more than twenty in some 
applications. The present method processes one sample at a time through the method that 
5 loops back to step 45 1 via the branch indicated by reference letter B, for example, from 
step 461, which will be described in more detail below. 

In a specific embodiment, the method has captured data about the plurality 
of samples from a data acquisition device. Here, each of the samples form a distinct class 
of data according to the present invention. The data acquisition device can be any 
10 suitable device for capturing either intrinsic or extrinsic information from a substance. As 
merely an example, the present method uses a data acquisition device for capturing 
olfactory information. The device has a pluraUty of sensors or sensing devices, which 
□ convert a scent or olfaction print into an artificial or electronic print. In a specific 

KSS, 

fO embodiment, such data acquisition device is disclosed in WO 99/47905, WO 00/52444 

y 15 and WO 00/79243 all commonly assigned and hereby incorporated by reference for all 
In purposes. Those of skill in the art will know of other devices including other electronic 

[y noses suitable for use in the present invention. In a specific embodiment, the present 

invention captures olfactory information from a plurality of different liquids, e.g., 
ly isopropyl alcohol, water, toluene. The olfactory information from each of the different 

20 liquids is characterized by a plurality of measurable characteristics, which are acquired by 
H the acquisition device. Each different Uquid including the plurality of measurable 

characteristics can be converted into an electronic data form for use according to the 

present invention. 

The method acquires the raw data from the sample in the training set often 
25 as a voltage measurement, step 452. The voltage measurement is often plotted as a 

ftmction of time. In other embodiments, there are many other ways to provide the raw 
data. For example, the raw data can be supplied as a resistance, a current, a capacitance, 
an inductance, a binary characteristic, a quantized characteristic, a range value or values, 
and the like. Of course, the type of raw data used depends highly upon the application. 
30 In some embodiments, the raw data can be measured multiple times, where an average is 
calculated. The average can be a time weighted value, a mathematical weighted value, 
and others. 

Next, the method checks the baseline voltages from the plurality of sensing 
devices used to capture information from the sample, as shown in step 453. The method 
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can perform any of the baseline correction methods described herein, as well as others. 
Additionally, the method can merely check to see if each of the sensing devices has an 
output voltage within a predetermined range. If each of the sensing devices has an output 
voltage within a predetermined range, each of the sensing devices has a baseline voltage 
that is not out of range. Here, the method continues to the next step. Alternatively, the 
method goes to step 455, which rejects the sensing device that is outside of the 
predetermined voltage range, and then continues to the next step. In some embodiments, 
the sensing device that is outside of the range is a faulty or bad sensor, which should not 
be used for training or analysis purposes. 

The method then determines if the measured voltage for each sensing 
device is within a predetermined range, step 454. Exposing the sensor to the sample 
provides the voltage for each sensor. The exposure can be made for a predetermined 
amount of time. Additionally, the exposure can be repeated and averaged, either by time 
or geometrically. The voltage is compared with a range or set of ranges, which often 
characterize the sensor for the exposure. If the exposed sensing device is outside of its 
predetermined range for the exposure, the method can reject (step 455) the sensor and 
proceed to the next step. The rejected sensor may be faulty or bad. Altematively, if each 
of the sensing devices in, for example, the array of sensors is within a respective 
predetermined range, then the method continues to the next step, which will be discussed 
below. 

The method can convert the voltage into a resistance value, step 456. 
Altematively, the voltage can be converted to a capacitance, an inductance, an 
impedance, or other measurable characteristic. In some embodiments, the voltage is 
merely converted using a predetermined relationship for each of the sensing devices. 
Altematively, there may be a look up table, which correlates voltages with resistances. 
Still further, there can be a mathematical relationship that correlates the voltage with the 
resistance. 

The method then runs the data through one or more filters, step 457, The 
method filters the data to remove any imperfections, noise, and the like. As merely an 
example, data from the present data acquisition device are often accompanied with 
glitches, high firequency noise, and the like. Here, the signal to noise ratio is often an 
important consideration for pattern recognition especially when concentrations of 
analytes are low, exceedingly high, or not within a predefined range of windows 
according to some embodiments. In such cases, it is desirable to boost the signal to noise 

22 



ratio using the present digital filtering technology. Examples of such filtering technology 
includes, but is not limited to a Zero Phase FiUer, an Adaptive Exponential Moving 
Average Filter, and a Savitzky-Golay Filter. 

The method runs a response on the data, step 458. Here, the method may 
perform a baseline correction step. Depending upon the embodiment, there can be many 
different ways to implement a baseline correction method. Here, the baseline correction 
method finds response peaks, calculates AR/R, and plots the AR/R verses time stamps, 
where the data have been captured. It also calculates maximum AR/R and maximum 
slope of AR/R for further processing. Baseline drift is often corrected by way of the 
present step. Once baseline drift has been corrected, the present method undergoes a 
normalization process, although other processes can also be used. Here, AR/R can be 
determined using one of a plurality of methods, which are known, if any, or developed 
according to the present invention. 

In the present embodiment, the method is for analyzing a training set of 
substances, step 459 (in Fig. 4E). The method then continues to step 461. Altematively, 
the method skips to step 467, which will be described in one or more of the copending 
applications. If there is another substances in the training set to be analyzed (step 459), 
the method returns to step 452 via branch B, as noted above. Here, the method continues 
until each of the substances in the training set has been run through the process in the 
present preprocessing steps. The other samples will run through generally each of the 
above steps, as well as others, in some embodiments. 

Next, the method goes to step 463. This step determines if any of the data 
has an outlier. In the present embodiment, the outlier is a data point, which does not 
provide any meaningfiil information to the method. Here, the outlier can be a data point 
that is outside of the noise level, where no conclusions can be made. The outlier is often 
thought of a data point that is tossed out due to statistical deviations or because of a 
special cause of variation. That is, lowest and highest data points can be considered as 
outliers in some embodiments. If outliers are found, step 463, the method can retake (step 
465) samples, which are exposed to the sensing devices, that have the outliers. The 
samples that are retaken loop back through the process via the branch indicated by 
reference letter B. Outliers can be removed firom the data in some embodiments. 

The method also can uncover important sensors using an importance index 
(individual filtering process). Here, the method identifies which sensors do not provide 
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any significant information by comparing a like sensor output with a like sensor output 
for each of the samples in the training set. If certain sensors are determined to have little 
influence in the results, these sensors are ignored (step 473) and then continues to the next 
step, as shown. Alternatively, if generally all sensors are determined to have some 
5 significance, the method continues to step 467. 

Next, the method performs post processing procedures (step 467), as 
defined herein. The post processing procedures include, for example, a normalization 
step. In a specific embodiment, the normalization step scales the data to one or other 
reference value and then autoscales the data so that each sample value is referenced 
10 against each other. If the data is for the training step, step 468, the method continues to a 
pattern recognition cross-validation process, step 469, the cross validation process is used 
with step 470. 

As described previously, the pattem recognition process uses more than 
one algorithm, for example fi-om Table I, which are known, are presently being 
1 5 developed, or will be developed in the fixture. The process is used to find weighting 
factors for each of the characteristics to ultimately determine an identifiable pattem to 
id uniquely identify each of the substances. The present method runs the data, which have 

been preprocessed, through each of the algorithms. 
W Once the best fit algorithm and model has been uncovered, the method 

20 goes through a discrimination test, step 471. In a specific embodiment, the method 
compares the results, e.g., fit of data against algorithm, combination of data and other 
preprocessing information, against confidence factor (if less than a certain number, this 
does not work). This step provides a final screen on the data, the algorithm used, the pre- 
processing methods, and other factors to see if everything just makes sense. If so, the 
25 method selects the final combination of techniques used according to an embodiment of 
the present invention. 

The above sequence of steps is merely illustrative. The steps can be 
performed using computer software or hardware or a combination of hardware and 
software. Any of the above steps can also be separated or be combined, depending upon 
30 the embodiment. In some cases, the steps can also be changed in order without limiting 
the scope of the invention claimed herein. One of ordinary skill in the art would 
recognize many other variations, modifications, and altematives. 
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EXAMPLE 

To prove the principle and operation of the present invention, a computer 
software program was coded and used to implement aspects of the present invention. 
This program is merely an example, which should not unduly limit the scope of the 
claims herein. One of ordinary skill in the art would recognize many other variations, 
modifications, and altematives. Here, a program package named "Simulation" has been 
written in MATLAB with a graphical user interface (GUI) to simulate the data input from 
chemical sensors, data preprocessing and pattern recognition so that users can try 
different algorithms to find the best method to meet a certain application. This procedure 
includes many recommendations about details of operation to help users perform their 
specific task. It is demonstrated that "PC- Simulation" is a good and powerful tool in 
R&D, Details of Simulation are provided below according to the headings. The present 
invention provides a graphical user interface that includes a desktop workspace with a 
background. 

1 . Configuration 

The "Simulation" package has been installed on a server. Here, MATLAB 
can be installed on client devices, where each of the client users accesses Simulation on 
the server. Once the MATLAB program has been installed on the client computer, the 
MATLAB icon is prompted on the computer. To launch the MATLAB program, the user 
double-clicks on the MATLAB icon. 

2. Commands 

Having launched the MATLAB program, a MATLAB command window 
with a few lines of notes is shown. There is a sign » prompt on the left of the screen, 
followed by a cursor, which means that it is ready to receive a command. This command 
window is also called "workspace". It is used to enter commands, display results and 
error messages. 

As an example, a few useftil commands in MATLAB are set forth in Table III. 
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TABLE III 





Oommand 


Description 




whos 


list all the variables in the memory 




cd 


chanee directorv 




Is 


list all the files in the directorv of *'work" 




dir 


the same as Is 




fir* 


pra^p all in the command window 

CXOV' CIXX XXX LXXw WVyXXXXXXvU.X\J> TV X^XVAV./ TT 






delete all the variables in the memorv 




Clear vdrid.Dic 


{\r\\\j H*»lptp tVip \/5ii*i5iH1p witVi thfit namp 

Ulliy VJ-CICLC Lite VClllCHJlt' WlLll lllCll iiCllXXV 




IldillC 








list MATLAB path 

XX XtX.X X- X X-^X ■ 1 ^ l^rM-^XX 




aaVCllldlctlllv;/ 


C5i\/f» \/5iri5iHlp nr variahlp*; into a mat file with filename 




V 51 tH ?i V\ 1 f*n 51 m f* 


and store in the "work" directorv 




C51\/P ^11^1151111^ 


asrii «;ave to a text file that can be loaded into excel 




vari 5iV>lf*Tiamp 

V CU IdU'lVi'liCilllw 






lojiH filpnamft 


load variable or variables from the file into the workspace 




global 


enable to list global variables in the workspace 




variablename 




Cm 


delete filename 


delete the file from the disk ("work" folder) 


PS s 


A = B; 


assign matrix A equal to B 


! a 3 


A = B'; 


assign matrix A equal to B transpose 


i : 


A = B(3:5,:); 


A matrix consists of the rows 3 to 5 of B matrix 


I t i 


A = B(:,2:9); 


A matrix consists of the columns 2 to 9 of B matrix 



The convention of data matrix set in chemometrics is that columns are 
variables (sensors) and rows are samples (exposures). For example, A(2,12) is referred to 
5 as data element on the second row (the second exposure) and the 12th column (sensor 
#12). A semicolon (;) at the end of command line will suppress the data display on the 
workspace. 

Sometimes it is desirable to manipulate the data to delete rows (samples) 
or columns (variables) from a matrix. Here, command - delsamps is used. To delete row 
10 12 from a matrix called data, type in 
» a = delsamps(data, 12); 

where a is the result matrix that comes from data without row 12. 

To delete column 10 from a matrix called data, type in 
» b = delsamps(data', 10)'; 
15 where b is the result matrix that comes from data without column 10. 
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3. Import and Export Data 

Using save filename variablename -ascii command, the data file can be 
saved in the MATLAB workspace to a text file (tab-delimited). Then, it can be loaded 
into a spreadsheet such as Excel^^ by Microsoft Corporation. On the other hand, if a data 
matrix exists in Excel, the data file can be saved to a tab-delimited text file. This can be 
done with data matrix without headers. From the file menu of the MATLAB workspace, 
check "load workspace", a dialogue box can then be launched. Next, any table-delimited 
data file can be loaded into the MATLAB workspace. 



4. Method of Operation 

The present method begins with a startup procedure. Here, upon the 
cursor (»|) prompt on the MATLAB workspace, "simulhh" starts the PC-Simulation 
program. The PC-Simulation GUI 500 shown in Fig. 5 A, appears on the terminal. The 
figure is merely an example, which should not limit the scope of the claims herein. One 
of ordinary skill in the art would recognize many other variations, modifications, and 
alternatives. The GUI includes at least the following parts: 

(a) A series of pop-up menus 501 on the left panel simulate data loading, and data 
preprocessing. 

(b) A graphical display 503 at the center of the GUI shows the images and plots of 
simulation. 

(c) A mini command window 505 at the lower center of the GUI prompts the 
computation status and displays the results of simulation. 

(d) A list-box and a push button (Load Training) 507 on the top right panel of GUI 
simulate the handheld type data loading. During operation, samples are loaded via 
one class after another class 509. The outlier, which is data outside an acceptable 
boundary, will be found and removed. The class information will be attached. Using 
"Save" and "load" buttons 507, training data can be saved to a file and can be 
reloaded into the workspace. A pop-up menu "Pattern Recognition" 511 on the right 
panel contains many algorithms for pattern recognition. They will be discussed in 
detail later. 

(e) A push button "Auto CV" 513 inidates the auto cross validation mode. The program 
will alternatively make a subset of the training data and use its class information to 
build models, and use the models to predict the rest of the training data. After 
calculating all the combination of scaling and algorithms, the program will make a 
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percentage list of correct predictions. The list will be shown on the mini command 
window. From there, a judgment can be made as to which algorithm works better in 
the application. 

(f) An "info" button 517 displays the program information on the mini command 
5 window. 

(g) A "Close" button 519 will stop and close the GUI program. 

The GUI set forth in Figure 5A is merely an example. It should only 
provide the reader an understanding of the present example, without unduly limiting the 
scope of the claims herein. One of ordinary skill in the art would recognize many other 
10 variations, modifications, and alternatives. 

5. Load Data 

After the data is loaded, the arrow 521 on the top-left pop-up menu of 
"Process Option" uncovers two choices, which pop-up, i.e., "Labnose" and "Datalogger" 

15 523. A cursor can be moved with the mouse button down to highlight "Labnose" and 
then released if chemical lab data is loaded from a file collected from the Keithley 
Instrument, which gathers resistance data. Having done this, a dialogue box browser will 
appear. From there, the data file can be searched through the hard disk. Once a desired 
file is found, the open button retrieves the data from that data file. In a similar way, the 

20 "Datalogger" menu can be highlighted to load the data file collected from the Datalogger 
from the above capturing device. The mini command window will show the status of 
data loading. When the data loading is done, the method goes to the next processing step 
to choose one of the digital filters. 

25 6. Digital filtering 

The data collected from some chemical sensors are sometimes 
accompanied with glitches and relative high frequency noise (compare to the signal 
frequency). Here, the signal to noise ratio (SNR) is often important for pattern 
recognition especially when concentrations of analytes are low, exceedingly high, or not 

30 within a predefined range of windows. In such cases, it is important to boost the signal to 
noise ratio using the present digital filtering technology. Multiple digital filters have been 
implemented in the Simulation, e.g., Zero Phase Filter, "zero phase", Adaptive 
Exponential Moving Average Filter, "exp-mov-avg", and Savitzky-Golay Filter, 
"savitzky-go". In operation, the mouse can be used to pull down an arrow 525, which 
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displays the filters 527. The mouse is used to highlight one of the fiUers to select it. In 
some embodiments, the program will run that digital filter immediately after releasing the 
mouse. As merely an example, some details of such filters are set forth below. 

(a) Zero-Phase Filter uses the information in the signal at points before and after the 

5 current point, in essence "looking into the fiature," to eliminate phase distortion. Zero- 

Phase Filter does use the z-transform of a real sequence and the z-transform of the 
time reversed sequence. Preferably, the sequence being filtered should have a length 
of at least three times the filter order and it tapers to zero on both edges. 

(b) Savitzky-Golay Filter performs Savitzky-Golay smoothing using a simple polynomial 
10 to a running local region of the sample vector. At each increment, a polynomial of 

order is fitted to the number of points (window) surrounding the increment. 

(c) Both Zero-Phase Filter and Savitzky-Golay Filter are post data process type filters. 
C3 To the contrary, Adaptive Exponential Moving Average Filter can be used as a real- 
time filter. It does not need to store the whole scan of data into the memory and then 

15 process it. Currently the filter window is set at 1 1 points and it was found that 

Savitzky-Golay Filter gives a good result of data smoothing without significant 
distortion. 

Although the above has been generally described in terms of specific 
filters, those of skill in the art will be aware of other filters suitable for use in the present 
"iS 20 invention. 
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7. Viewing Sensor Responses 

Sensor responses can be viewed using the present GUI 503, which 
illustrates AR/R against time in seconds. Another pop-up menu 531 on the left is called 

25 "Figure Lisf . A click on the arrow 529 displays a hst fi-om 1 to 16. Each figure has the 
responses of four sensors in order. For example, figure 1 contains responses of sensor 1 
to 4. Likewise, figure 2 contains responses of sensors 5 to 8. Move the mouse arrow to 
highlight the figure number 3, a response plot of sensors 9 to 12 with filtered and without 
filtered data will display on the graphical window as shown in a diagram of Fig. 5B, for 

30 example. Like reference numerals are used in this Figure as the previous Figure for easy 
referencing, without limiting the scope of the claims herein. As shown, the diagram 
illustrates a filter response 541 for each of the sensors (e.g., sensor 9, sensor 10, sensor 
11, sensor 12) in the array. Here, the filtered data are usually in dark colors, such as red, 
blue, and black. If the data set is huge and has many exposures, the plot will be packed 
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with response peaks and it could be hard to view the detail. By way of the present 
example, it is possible to view the detail of data preprocessing. The example also allows 
noise levels for each of the sensors. Additionally, the example illustrates how well the 
filter worked. The example also allows how the sensor responds to different analytes 
5 within the certain exposure time. The example also allows us to examine how the 

baselines drift (which is, for example, a nominal change in sensor resistance over time). 
In these examples, it may be desirable to load a piece of data, such as six exposures along 
the horizontal time axis or less as shown. Once the piece of data has been loaded, pre- 
processing can be performed. Using, for example, Wordpad by Microsoft Corporation, it 
10 is possible to cut and paste the data to create a subset of the data file. Once the desired 
filter has been found and used, the present method goes to a baseline correction step, as 
indicated below. 



8. Baseline Correction 

15 Depending upon the embodiment, there can be many different ways to 

implement a baseline correction method. In the present example, three methods for 
baseline correction have been implemented in the simulation. These correction methods 
were called "min max", "baseline corr", and "extrapolate". Selection occurred by 
clicking 533 the popup menu of "baseline corr", and selecting 534 one of the methods. 

20 The program guided by the flags set in the data file runs the baseline correction method 
according to user's choice, finds the response peaks, calculates the ARTR, and plots the 
AR/R vs. time stamps. It also calculates the maximum AR/R and the maximum slope of 
AR/R for further processing. As shovra in Fig. 5C, the responses of all the sensors after 
baseline correction are displayed 503. In the graph, 32 traces of sensor responses with six 

25 exposures vs. time are plotted. As noted, the baseline drift 543 has been corrected as 
shown in Fig. 5C as compared to the responses in the previous Figures, which illustrate 
varying baseline displays. Weighting, such as Zero-Weighting on insignificant signals, is 
also included in the program. The threshold has been set at SNR equal to three. Once 
baseline drift has been corrected, the present method undergoes a normalization process, 

30 although other processes can also be used. 
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9. Normalization 

Normalization is provided in the following manner. Here, the user clicks 
on the popup menu of Normalization and three choices: "none", "1-norm", and "2 -norm" 
appear, as illustrated in part in Fig. 5D. Depending upon the embodiment, other choices 
5 may also appear. The convention of the data matrix after the baseline correction is to set 
samples (exposures) along the rows and variables (sensors) along the columns. The 
normalization is a row wise operation. 1-norm is the so-called area normalization. After 
1-norm, the sum of data along each row is unity. 2-norm is the so-called vector length 
normalization. After 2-norm, the sum of data squared of each row equals unity. From 
10 studies, it is concluded that the AR/R of the sensor is proportional to the concentration if 
the sensor reaches equilibrium during the exposure time. Theoretically the normalization 
of such data should make a same response pattern even if the sensor is exposed to a 

'^z different sample concentration. 

Cm 

C3 Here, a pseudo-color graph of 1-norm data is shown in the simplified 

<i - +■ « 

ft 1* 

In 15 diagram of Fig. 5D with a color bar. The graph is plotted as sensor number vs. sample 

fl number. The peaks are marked red and the valleys are in dark blue. The pattem in the 

W 

s graph is repeated as samples are counted fi-om 1 to 6. Up to this step, the training data 

set has been created. Click on the workspace window to bring it to the front and type 
"whos," and the data set called trainpk with variable and size info display on the 
20 workspace will be displayed. 



13 



: 3 



10. Viewing Plots 

The present method also allows for viewing the plots in a variety of 
different configurations, as illustrated in Fig. 5E. The popup menu of Viewing Plots will 
25 not alter the data of "trainpk", but will allow to view different plots such as 2D spectra, 
3D plots of sensors, mean-centered, and auto-scaled. One of the usefixl plots is the 2D 
spectra plot that is shown in the Fig. 5E. Keeping these plots in the file folder, any sensor 
can be followed for drifting and check consistency of sensor responses day after day. 

30 11. Save Preprocessed Data 

To save the preprocessed data, trainpk, the trainpk can be assigned to a 
variable with a new name first and then save it to a mat file or ascii file. If a file name 
called ttbl 122 is to be saved, the command window can be entered as follows, 
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» ttbll22 = trainpk; 
» save ttbl 122 ttbl 122; 

A ttbl 122.mat file is saved in the "work" folder, or 

» save ttbl 122 ttbl 122 -ascii; 

A ttbl 122.txt file is saved in the "work" folder. 

1 2 . Auto Preprocessing 

After having gone through all the preprocessing steps, the preprocessing 
choices have been selected. The GUI shows the choices on their popup windows and 
keeps them intact. In certain aspects, it is desirable to preprocess many data sets, here 
the auto mode can be run by pressing the button of "Load Unknown" at the bottom left of 
the GUI. The program follows the previously set preprocessing steps and runs 
automatically, but can also be run semi-automatically. The resulting matrix is called 
samplepk. To save samplepk, the samplepk can be assigned to a variable with a new 
name first and then save it to a mat file or ascii file as trainpk, for example: 
» ttbl 123 = samplepk; 
» save ttbl 123 ttbl 123. 

On the top-right panel, there is a hst box, "Select Class" and a few push 
buttons, "Load Training", "Save", and "Load". If each data file is in one class, these 
buttons can be used to run auto preprocessing. Here is the procedure: 

(a) Use the mouse button to highhght class info in the Hst box on the top-right panel, e.g., 
Class 1 or Class 2 or... 

(b) Push "Load Training" button. The GUI will automatically run through the 
preprocessing steps and use PC A to screen and delete the outliner if there is any. If 
the number of samples in that class is less than ten, the program will ask for more 
loading of samples belonging to that class. In that case, it is desirable to push "Load 
Training" button again. 

(c) Use the mouse button to highlight another class info in the list box. 

(d) Push "Load Training" button to load samples belonging to that class. 

(e) Repeat the same procedure until all the samples have been loaded. 

(f) The result is that the training set matrix, trainpk, and class vector, class, have been 
created in the workspace. 

(g) Pushing "Save" button, will save trainpk and class into a mat file with a different file 
name. 
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(h) Later on, if the "Load" button is pushed the file can be reloaded into the workspace. 

1 3 . Comments on Data Preprocessing 

To perform pattern recognition, the choices of preprocessing for all the 
data sets must often be consistent; otherwise the prediction will generally not work in an 
efficient manner. To build model from a training set, the matrix is assigned the name of 
trainpk, for example. Here, the number of samples in each class is maintained the same. 
A class info vector called class is created unless the right panel is used for data 
preprocessing. For the turn-table data with six classes, assign class = [1234561234 
5 6...]. For the labnose data, assign class= [1 11111111122222222223333 
. . .]. In certain instances, it is desirable to make trainpk from data set ttbl 122 and to tailor 
it, thus, type: 

» trainpk = ttbl 122(13:72,:). 

Then trainpk will have 60 rows from row 13 to 72 of the matrix ttbl 122. 
To do prediction, assign the unknown data set (matrix) to the name of samplepk. 
Thereafter, type » samplepk = ttbl 123(13:18,:). Then samplepk will consist of six rows 
of the matrix ttbl 123. 

The data preparation has been described in this section. As long as trainpk 
and the class vector are compatible, the program is then ready to run the pattem 
recognition programs. 

1 4. Pattem Recognition 

The popup menu "Pattem Recogn" 5 1 1 at the middle of right panel 
initiates the pattem recognition algorithms. CHck on the arrow 511 to see a pull-down 
menu with all the abbreviations as described in Table I above. As discussed above, the 
top two menus, PCA and HCA, are unsupervised learning methods. They are used for 
investigating training data. The other four algorithms, KNN CV, SIMCA CV, Canon CV, 
and Fisher CV, are supervised learning methods used when the goal is to constmct 
models to be used to classify future samples. These algorithms will do cross validation, 
find the optimum number of parameters, and build models 

15. Principal Components Analysis (PCA) 

Principal Component Analysis (PCA) is an unsupervised method that 
reduces the number of required variables to analyze similarities and differences amongst a 
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set of data. The method produces a scores plot for this analysis. The number of principal 
components (PC's) is automatically determined. Each axis of the graph is assigned a PC 
number, and the percent variance captured with the particular PC is shown along the axis. 

PC A of data may be performed utilizing a number of software programs. 
One such program is the PLS^Toolbox available ft*om Eigenvector Research, Inc. of 
Manson, Washington. To perform PCA using this tool, "PCA" is highlighted in the 
popup menu of "Pattern Recogn" opens a PCA GUI. From the top menu bar of that GUI, 
click on PCA_File, and highlight Load Data. The file trainpk can be selected to load into 
the PCA program. When it is done, the window looks similar to output 550 in Fig. 5F. 
On the top-left comer 557, it shows that trainpk has been loaded with size 60 rows x 32 
columns. The push button calc 558 has been clicked and the program will run PCA, 
calculates Eigen values and Eigen vectors, and lists all the percent variance captured by 
PCA model as shown. From the table 559, it is desirable to find that four principal 
components already have captured 96.05% of variance. Using more PCs may not 
improve the PCA model much but capture more noise. For example, in certain instances, 
it desirable to choose four PCs. Thus, click on the line of 4 PCs 561. That line of data 
will be highlighted, as shown. Next, click on the button apply 563, and the model with 
four PCs is calculated. Five plot push buttons 551, eigen 552, scores 553, loads 554, 
biplot 555, data 556 are highlighted. 

In other aspects, push the button "scores," and choose to plot PCI vs. PC2, 
and see a Scores Plot as displayed in a spatial configuration of Fig. 5G. Here, the Fig. 
depicts that the training data has six classes, and are grouped well except class 1 and class 
6 with a little overlap. In some embodiments, make a 3D plot by choosing three PCs to 
plot. To print a hard copy, the "spawn" button is selected to create a separate plot 
window, which can be printed. 

Figs. 5K and 5L show altemative approaches for performing PCA. Fig. 
5K shows a three-dimensional Scores Plot 590. Fig. 5L shows a graphic user interface 
for this approach, wherein clicking the arrow of "Pattem Recogn" and highlighting 
"PCA" causes a pop-up window to appear. This pop-up window allows the user to select 
the method of pre-processing (i.e. no pre-processing, mean-center, or auto-scale). As 
shown in Fig. 5L, the Scores Plot then appears. In the menu option, the user may select 
"zoom in", "zoom out", or "rotate" to change the view of the scores plot in the graphical 
display. 
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16, Mean Centering and Autoscaling 

The default setting in the PCA GUI is autoscaling. From the menu bar of 
the PLS_Toolbox application, by selecting PCA_Scale, the method can change among no 
scaling, mean center, and autoscaling. PCA is scale dependent, and numerically larger 
5 variables appear more important in PCA. In certain instances, the data that varies around 
the mean is of interest. Mean centering is done by subtracting the mean off the variables 
in each column, thus forming a matrix where each column has a mean of zero. 
Autoscaling is done by dividing each variable (already mean centered) in each column by 
its standard deviation. The variables of each column of the resulting matrix have unit 
10 variance. The button, auto CV, will run the algorithms with mean centering and 
autoscaling to do cross validation and find out what combination gives the best 
prediction. 

f 3 

ff^ 17. Hierarchical Cluster Analysis (HCA) 

ill ti^*. 

^f; 15 Hierarchical cluster analysis (HCA) is an unsupervised technique that 

in examines the inter-point distances between all of the samples, and presents that 

l^i information in the form of a two-dimensional plot called a dendrogram as shown in Fig. 

5H. To generate the dendrogram, HCA forms clusters of samples based on their neamess 
ty in row space. Click the arrow of "Pattern Recogn" and highlight "HCA", the GUI enables 

% 20 different approaches to measure distances between clusters, e.g., mean centering vs. 
□ autoscaling; single vs. centroid linking; run PCA vs. not run PCA; Euclidean vs. 

hiss. 

Mahalanobis distance. 

After having run the HCA, the mini window and the workspace lists all the 
links from the shortest distance to the longest distance. The clustering information is also 
25 shown in the dendrogram. The ordinate presents sample numbers and their class info; 

while the abscissas gives distances between sample points and between clusters. The six 
classes are well observed in that graph. The distances between sample points and 
between clusters can be found from the abscissas. 

30 18. Auto Cross Validation 

The method also performs a cross validation technique. Here, click the 
button, "Auto CV," and the Simulation GUI will run cross validation using all the 
supervised techniques with the combination of either mean centering or autoscaling. The 
Auto CV finds the optimum combination of scaling and algorithm, the optimum number 
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of principal components, and the optimum K in KNN CV. The results of top five 
predictions firom Auto CV are presented in the mini window as shown in Fig. 51. It may 
be desirable to use the information to construct other models to get better classification. 

In the Simulation program, an auto cross-validation algorithm has been 
5 implemented. Cross- Validation is an operation process used to validate models built with 
chemometrics algorithms based on training data set. During the process, the training data 
set is divided into cahbration and validation subsets. A model is built with the calibration 
subset and is used to predict the vaUdation subset. One approach of dividing the training 
data set into calibration and validation subsets is called "leave-one-out", i.e., take one 
10 sample out fi-om each class to build a validation subset and use the rest samples to build a 
calibration subset. This process is repeated using different subsets until every sample in 
the training set has been included in one validation subset. The predicted results are 
C3 stored in an array. Then, the correct prediction percentages (CPP) are calculated, and are 

[O used to validate the performance of the model. 

Jr! 15 In the Simulation program, the cross-validation with one training data set 

m can be applied to all the models built with different algorithms, such as K-Nearest 

M Neighbor (KNN), SIMCA, Canonical Discriminant Analysis, and Fisher Linear 

L Discriminant Analysis, respectively. The results of correct prediction percentages (CPP) 

|,y show the performance differences with the same training data set but with different 

20 algorithms. 

H During the model building, there are several parameters and options to 

choose. To build the best model with one algorithm, cross-validation is also used to find 
the optimum parameters and options. For example, in the process of building a KNN 
model, cross-validation is used to validate the models built with different number of K, 

25 different scaling options, e.g., mean-centering or auto-scaling, and other options, e.g., 

with PC A or without PC A, to find out the optimum combination of K and other options. 

Auto-Cross-Validation has been implemented in the Simulation GUI via 
one push-button. It will automatically run the processes mentioned above over all the 
algorithms with the training data set to find out the optimum combination of parameters, 

30 scaling options and algorithms. Using that information, it is possible to build a model to 
get better classification capability. 



36 



1 9. Construct Models 

In some embodiments, the method constructs models. Here, click the 
popup menu, "SIMCA CV," and the Simulation GUI will construct a SIMCA model 
5 based on choice of scaling. After it is done, the graph window shows the plots of Q vs. T 
of each class, and the mini window displays that 4 PCs have been chosen to construct the 
model and the predictions of cross validation are, say, 100% correct. A data structure (the 
model) named simcamod has been created in the workspace if whos is typed in the 
workspace. A KNN Model, knnmod. Canonical Model, canmod, and Fisher Linear 
10 Discriminant Model, fldmod, can be constructed in the same way by clicking and 

highlighting the popup menus, respectively. Validation can occur by typing whos to 
validate how many models are there in the workspace, as illustrated by Fig. 5 J. 



20. Make Predictions 
H 15 The unknown samples to be predicted are named as samplepk. In certain 



3" T^*^ 



S 5 



r"3 



aspects, there are two ways to make unknown samples, samplepk: 

• Push "Load Unknown" button, the Simulation GUI will load unknown samples 
from a raw data file, preprocess it automatically and create samplepk. 

• Tailor the preprocessed data as mentioned before and assign it to samplepk, such 
20 as » samplepk = ttbl 123(13:18,:). 

To make a prediction, click the popup menu and highlight corresponding menu to initiate 
prediction run. KNN Prd will run KNN model on the unknown samples, and present the 
prediction results in the mini command window. The prediction results will be like: 

25 • Unknown 1 belongs to class 1; Goodness Value = -0.8976 

• Unknown 2 is close to class 2; Goodness Value = 4.8990 

If the Goodness value is less than 4, it will be considered belonging to that class. 

Click on the buttons of SIMCA Prd, Canon Prd, and FisherPrd 
respectively, and the Simulation GUI will do the same. The prediction results with the 
30 information of probabilities or confidence levels will be presented in the mini command 
window. 
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SIMCA Prd gives predictions with rms normalized distance levels. If the 
level is greater than 1.414, the unknown is not considered belonging to that class, but it is 
close to that class. 

Canon Prd provides predictions with probability level values. If the 
probability level is less than 0.99, the unknown sample is considered belonging to that 
class; otherwise, it will be pointed as belonging to the closest class. 

While the invention has been described with reference to certain illustrated 
embodiments this description is not intended to be construed in a limiting sense. For 
example, the computer platform used to implement the above embodiments include 586 
class based computers. Power PC based computers, Digital ALPHA based computers, 
SunMicrosystems SPARC computers, etc.\ computer operating systems may include 
WINDOWS NT, DOS, MacOs, UNIX, VMS, etc.; programming languages may include 
C, C^^, Pascal, an object-oriented language, HTML, XML, and the like. Various 
modifications of the illustrated embodiments as well as other embodiments of the 
invention will become apparent to those persons skilled in the art upon reference to this 
description. 

In addition, a number of the above processes can be separated or combined 
into hardware, software, or both and the various embodiments described should not be 
limiting. As will be appreciated by one of skill in the art, the present invention can be 
embodied as a method, data processing system, or computer program product. 
Accordingly, the present invention can take the form of an entirely hardware 
embodiment, an entirely software embodiment or an embodiment combining software 
and hardware aspects. Furthermore, the present invention can take the form of a 
computer program product on a computer-usable storage medium having computer- 
usable program code embodied in the medium. Any suitable computer readable medium 
can be utilized including hard disks, CD-ROMs, optical storage devices, or magnetic 
storage devices. It will be understood, therefore that the invention is defined not by the 
above description, but by the appended claims. All publications, patents, and patent 
appHcations cited herein are hereby incorporated by reference for all purposes in their 
entirety. 
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